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(54) Transmission method and system for JPEG-coded images 



(57) The present invention is an improved transmis- 
sion system for JPEG images. The present invention 
may Include a separator for separating the JPEG image 
into Type-I and Type-ll information and a transmitter for 
transmitting the Type-I and Type-ll information over a 
wire or wireless communication medium to a receiver 
with unequal error protection, wherein the more error 
sensitive Type-I information is provided with more pow- 
erful error protection than the less sensitive Type-ll in- 
formation which makes up the bulk of the JPEG image. 
The present invention may further include a combiner 
for combining the Type-I and Type-ll information re- 
ceived by the receiver in a JPEG format suitable for the 
data sink. 
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Description 

FIELD OF THE INVENTION 

The present invention relates generally to the field 
of communications, and particularly to JPEG image 
transmission over wire or wireless communication chan- 
nels. 

BACKGROUND OF THE INVENTION 

JPEG is the international standard for still image 
compression. JPEG stands for the Joint Photographic 
Experts Group -the group which developed the interna- 
tional standard. A complete description of the JPEG 
standard is given in W.B. Pennebaker, J.L. Mitchell, 
JPEG Still Image Data Compression Standard (Van 
Norstrand Reinhold, New York 1 993). 

JPEG images are very sensitive to transmission er- 
rors. This sensitivity requires transmission over an al- 
most error-free channel. To maintain an error-free chan- 
nel involves advanced error correction coding tech- 
niques and/or retransmission of those portions of a 
JPEG image which are received in error. 

Both protocols result in decreased channel through- 
put. For the error correcting protocols, bandwidth that 
could otherwise be used for transmitting the JPEG im- 
age is allocated for transmitting the redundancy bits of 
an error correction code. In the case of retransmission, 
the time that could otherwise be used to transmit anoth- 
er JPEG image, or at least more of the same JPEG im- 
age as a function of time, is allocated to retransmitting 
the erroneous portions of the JPEG image. 

There is a need for a transmission method and sys- 
tem that can more efficiently use the scarce resources 
of a communication channel to transmit JPEG images. 

SUMMARY OF THE INVENTION 

The present invention provides a transmission 
method and system that more efficiently uses a commu- 
nication channel to transmit JPEG images, and thereby 
increases the channel throughput. The present inven- 
tion does this by separating the JPEG image into differ- 
ent types of information based on the sensitivity of each 
type of information to transmission errors, and then 
transmits the different types of information with unequal 
error protection. 

One illustrative embodiment of the present inven- 
tion is an apparatus comprising a separator for separat- 
ing the JPEG image into Type-I and Type-ll information 
and a transmitter for transmitting the Type-I information 
with more powerful error protection than the Type-ll in- 
formation. 

The Type-I information, typically representing less 
than 10% of the JPEG image data, is the most error sen- 
sitive information, requiring an almost error-free channel 
for reliable data communication. The Type-ll informa- 



tion, representing the remainder of the JPEG image, is 
the least sensitive, requiring less powerful error protec- 
tion or none at all. Providing the Type-ll information with 
less powerful error protection, or no error protection at 

s all, increases the throughput and efficiency of the com- 
munication channel. 

Another illustrative embodiment of the present in- 
vention may provide even further improvement in chan- 
nel throughput and efficiency. This embodiment of the 

10 present invention comprises a separator for further sep- 
arating the Type-I information into Type-I A and Type-IB 
information and a transmitter for transmitting the Type- 
IA information with more powerful error protection than 
the Type-IB information. 

is Further illustrative embodiments of the present in- 
vention are provided for receiving, processing, and com- 
bining the transmitted Type-I and Type-ll information in 
a manner suitable for the data sink. 

Additional illustrative embodiments of the present 

20 invention include different error protection protocols for 
providing unequal error protection to the different types 
of information in a JPEG image. 

Still further illustrative embodiments of the present 
invention incorporate novel antenna diversity schemes 

25 for transmitting JPEG images over slow fading chan- 
nels. 

Other illustrative embodiments of the present inven- 
tion provide an improved storage system for JPEG im- 
ages. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows the structure of a typical JPEG com- 
pressed image. 
35 Fig. 2 is a table listing the start of frame markers in 

a JPEG image. 

Fig. 3 is a table listing the other, non-start of frame 
markers in a JPEG image. 

Figs. 4A-4C are tables listing the first 300 4-byte 
40 hexadecimal words in a typical JPEG image. 

Figs. 5A-5F show illustrative embodiments of the 
present invention using an ARQ feedback channel. 

Figs. 6A-6C illustrate multiplexed Type-I and Type- 
ll information packets of a JPEG image transmitted us- 
45 ing the present invention. 

Figs. 7A-7I show illustrative FEC embodiments of 
the present invention without an ARQ feedback chan- 
nel. 

Figs. 8A-8C show illustrative embodiments of the 
50 present invention using a hybrid ARQ feedback chan- 
nel. 

Figs. 9A-9D show illustrative storage embodiments 
of the present invention. 

55 
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DETAILED DESCRIPTION OF THE INVENTION 

The Structure of a JPEG Still image 

JPEG compressed image data contains two class- 
es of segments: entropy coded segments and marker 
segments. Entropy coded segments contain the entropy 
coded (e.g., Huffman or arithmetic coded) image data, 
and the marker segments contain header information, 
transformation and quantization tables, and other infor- 
mation requ ired to interpret and decode the entropy cod- 
ed image data. 

Fig. 1 shows the structure of a typical JPEG coded 
image 50. A start of image marker 10 and marker seg- 
ments 10A begin one or more image frames 20 (i.e., the 
compressed image data stream), and an end ol image 
marker 30 terminates the image frame or frames. The 
marker segments 1 0A define quantization tables, entro- 
py-coding (transformation) tables, and other miscella- 
neous parameters. 

A frame header 22 and marker segments 22A are 
generated at the beginning of each image frame 20. The 
frame header 22 begins with a start of frame marker fol- 
lowed by parameter values needed for decoding the 
frame. For example, the frame header defines the basic 
attributes of the image, including image size, number of 
image components, the mode of compression, and the 
entropy coder used within the frame. Like the marker 
segments preceding the image frame, marker segments 
22A also define quantization tables, entropy coding 
(transformation) tables, and other miscellaneous pa- 
rameters. 

Each image frame 20 is composed of one or more 
scans 23 through the image data, where a scan is a sin- 
gle pass through the data for one or more components 
of the image. The components of each scan are grouped 
into one or more entropy coded segments 23B which 
are separated by restart markers 23C. The components 
in each entropy coded segment are further grouped into 
one or more minimum coded units ("MCUs B ) generally 
representing 16x16 blocks of the image. 

Appended to the beginning of each scan in an im- 
age frame 20 is a scan header 23A. The scan header 
23A begins with a start of scan marker followed by pa- 
rameter values needed for decoding the scan, such as 
the number of components in the scan and the scan 
component specification. 

Marker segments begin with a "marker" which is a 
two-byte hexadecimal code or word. The first byte is al- 
ways a byte-aligned Oxff (Ox representing that the bytes 
in the image data stream are in hexadecimal form and 
the hexadecimal byte ff signifying a marker). The sec- 
ond byte is a "marker code 0 which identifies the function 
of the marker segment. The second byte is always a 
non-zero byte. For example, the start of image marker 
is OxffdS and the end of image marker is 0xffd9. In both 
cases, the byte ff denotes a marker, and the marker 
codes d8 and d9 identify the markers as the start of im- 



age and end of image markers, respectively. 

The tables in Figs. 2 and 3 list the markers in a 
JPEG image: the table in Fig. 2 includes the start of 
frame markers (defining the entropy encoding proce- 

s dure used), and the table in Fig. 3 includes all of the 
other, non-start of frame markers. These markers fall in- 
to two categories: those without parameters, and those 
followed by a fixed, undefined, or variable length se- 
quence of parameters. 

10 A "V notation in the length column of the tables in 
Figs. 2 and 3 represents a variable length parameter 
with a known structure; an "N" notation in the length col- 
umn represents that no parameter sequence follows the 
marker; a "U" notation in the length column represents 

15 that the parameter sequence is undefined; and a numer- 
ic notation in the length column represents a fixed 
number of parameter bytes following the marker. For ex- 
ample, in Fig. 3 the restart marker Oxff dO has no param- 
eters; the parameters of the define restart interval mark- 

20 er Oxffdd are contained in the 4 bytes immediately fol- 
lowing Oxffdd; and the start of scan marker Oxffda con- 
tains a variable-length parameter sequence. 

The first parameter in any marker segment is al- 
ways a two-byte code representing the length of the pa- 

25 rameter sequence. For example, a two-byte code 
0x0043 following the quantization table marker Oxffdb 
would represent that there are .67 parameter bytes fol- 
lowing the marker, including the two-byte length param- 
eter. 

30 Markers with parameters following them are gener- 
ally referred to as marker segments but the terms are 
used interchangeably in this application. 

Effect of JPEG Image Transmission Errors 

35 

The JPEG image is very sensitive to transmission 
errors. Applicants have determined that some portions 
of the JPEG image are more sensitive to transmission 
errors than others. Specifically, the marker segments 

40 have been determined to be more sensitive than the en- 
tropy coded segments. And among the marker seg- 
ments, the restart markers have been determined to be 
less sensitive than the other markers. 

The sensitivity of the JPEG image to transmission 

45 errors is illustrated using the first 300 4-byte words of a 
JPEG image shown in Figs. 4A-4C. A single bit error in 
the start of image marker 0xffd8 (Word No. 1) will de- 
stroy the image completely, such as, for example, where 
the start of image marker is converted to an end of image 

50 marker 0xffd9. Similarly, a single bit error in the quanti- 
zation table marker Oxffdb (Word No. 5) will have disas- 
trous results. For example, if a single bit error converts 
Oxffdb to start of frame marker Oxff cb or Oxffda the entire 
image will be lost. 

55 As mentioned above, errors in the restart markers 
will generally not result in loss or severe degradation of 
the image because there is a restart marker separating 
each of the entropy coded segments (or portions) of the 
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image. For example, in Figs. 4A-4C, each entropy cod- 
ed segment represents only one MCU or 16 x 16 block 
of image pixels. If the restart marker 0xffd3 (Word No. 
216) in Fig. 4 is changed by one bit to 0xffd2, another 
restart marker, the JPEG decoder will not decode the 
16x16 block of image data (Word Nos. 217-233) fol- 
lowing the erroneous marker ~ but that will not effect the 
JPEG decoder's ability to decode the rest of the image. 

Finally, entropy coded segments are the least sen- 
sitive to single bit errors during transmission, and that 
is because they only represent portions or blocks of the 
image. 

The present invention categorizes the JPEG image 
data by its relative sensitivity to transmission errors. The 
marker segments are defined as Type-! information and 
the entropy coded segments are defined as Type-ll in- 
formation. The Type-I marker segments can be further 
categorized based on their relative sensitivity to trans- 
mission errors. In this regard, because the restart mark- 
ers are less sensitive to transmission errors than the oth- 
er markers, they are defined as Type-IB information and 
the other markers are defined as Type-IA information. 

The transmission protocol of the present invention 
takes into account the sensitivity of each of the different 
types of information and uses different levels of error 
protection ("unequal error protection") for the different 
types of information. The highest protection is applied 
to the Type-IA information - which has the highest sen- 
sitivity to transmission errors. The same or a lesser level 
of protection is applied to the Type-IB information Fi- 
nally, the lowest level of error protection is applied to the 
Type-ll information - the least sensitive of the three 
types of information. 

Applying unequal error protection serves to reduce 
the overhead or bandwidth (i.e., the number of redun- 
dant bits) required for error protection, and thereby in- 
creases the throughput of the transmission system and 
more efficiently uses the communication channel. 
These advantages can be more fully appreciated by 
considering the relative contributions of each type of in- 
formation to the JPEG image. The most important type 
of information: the Type-IA information, typically takes 
up less than 1% of the JPEG image data stream, and 
the Type-IB information typically takes up only 5-1 0% of 
the JPEG image data stream. The rest of the JPEG im- 
age data stream consists of the least error sensitive 
Type-ll information. 

Automotive repeat request (ARQ), forward error 
correction (FEC), and hybrid ARQ protocols are com- 
mon error protection protocols for reliable data commu- 
nication. ARQ protocols use a feedback channel to re- 
quest retransmission of erroneous data packets and 
thereby provide a relatively error-free channel. FEC pro- 
tocols operate without a feedback channel but use pow- 
erful channel codes in an attempt to correct the trans- 
mission errors at the receiver. In sum, ARQ protocols 
provide more powerful error protection, but less efficient 
error protection than FEC protocols. Hybrid ARQ proto- 



cols, on the other hand, combine the features of the FEC 
and ARQ protocols to provide reliable and efficient error 
protection. 

The power of an error protection protocol is usually 
5 measured by its minimum "free distance," which is a 
term known to those of ordinary skill in the art. The great- 
er the free distance of an error protection protocol the 
more powerful the error protection. Error protection 
power may also be measured by the average bit error 
10 rate (BER) for the same signal-to-noise ratio (SNR), but 
only if the BER is relatively constant over time. The 
smaller the BER of an error protection protocol the more 
powerful the error protection. 

Stop and Wait ARQ is one form of ARQ protocol. 
is The transmitter appends parity check bits to the packets 
of data to be transmitted. The parity check bits enable 
the receiver to detect errors in the data packets. Many 
error detection coding techniques are known to those of 
ordinary skill in the art, including, for example, CRC-1 6, 
20 which is a 1 6-bit cyclic redundancy error detection code. 

Following the transmission of each data packet over 
a forward communication channel, the transmitter waits 
for a positive or negative acknowledgement (ACK or 
NAK) from the receiver. If no error is detected in the data 
25 packet, the received data packet is delivered to the data 
sink and a positive acknowledgement is sent back to the 
transmitter, which, in response, sends the next data 
packet to the receiver. If, on the other hand, an error is 
detected in the received data packet, the receiver dis- 
30 cards the data packet and a negative acknowledgement 
is sent to the transmitter which, in response, re-sends 
the same data packet. 

As mentioned above, the FEC protocols do not use 
an ARQ feedback channel. The transmitter introduces 
35 redundancy into the data stream to allow the receiver to 
correct errors in the erroneous data packets. FEC codes 
usually fall into two general categories: (i) block codes 
and (ii) convolutional codes. 

With convolutional codes, the encoder loads the 
40 bits from an incoming data stream into a tapped shift 
register and encodes each bit as it is loaded into the first 
position in the shift register. The encoding process in- 
volves combining the bit to be encoded with certain of 
the preceding bits in subsequent memory positions us- 
45 ing modulo 2 addition. 

The power of a convolutional code is determined by 
the "rate" and "memory" of the code. The "rate" is the 
number of bits output from the encoder for each bit input 
to the encoder. For example, a rate 1/2 convolutional 
50 encoder outputs two bits for every bit input to the encod- 
er. The "memory" determines how many of the preced- 
ing bits are used in encoding the current data bit; if four 
preceding bits in the data stream are used, the memory 
for the convolutional code is 4. In sum, the higher the 
ss rate and/or the larger the memory, the more powerful 
the convolutional code. 

A block code, in contrast to a convolutional code, 
encodes blocks of bits rather than individual bits. The 
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size of the tapped shift register for a block encoder is 
determined by the size of the block of bits to be encoded. 

A repetition code is one form of block code. Repe- 
tition codes send multiple copies of the same data pack- 
et. The error protection power of the repetition code in- 
creases with the number of copies of the packet that are 
sent. 

Finally, Hybrid ARQ schemes use an ARQ protocol 
with a FEC code to detect and correct errors. In one hy- 
brid ARQ, an erroneous data packet is re-sent only if it 
cannot be corrected by the FEC code. In another type 
of Hybrid ARQ scheme, the initial transmission is coded 
for error detection only and parity bits for error correction 
are transmitted only when necessary. The error protec- 
tion power of a hybrid ARQ would typically fall some 
where between the error protection power of pure ARQ 
protocols and that of powerful FEC protocols. 

Those of ordinary skill in the art will understand from 
the above discussion that there are numerous ways to 
embody Ihe unequal error protection of the present in- 
vention. The chosen embodiment for a particular appli- 
cation depends, among other things : on the bit error rate 
(BER) of the wire or wireless communication medium 
and the acceptable BER for the information being trans- 
mitted. 

For example, when a feedback channel is available, 
a relatively error free ARQ protocol may be used to 
transmit the Type-I information, without any error pro- 
tection for the Type-ll information which can handle the 
^TO -4 BER often associated with a wireless medium. Al- 
ternatively, a less powerful FEC code may be used for 
the Type-ll information. 

If no ARQ feedback channel is available, a repeti- 
tion type FEC code may be used for the Type-I informa- 
tion with no error protection for the Type-ll information. 
Alternatively, one non-repetition FEC code (e.g., a con- 
volutional code with rate 1/3 and memory 4) may be 
used for the Type-I information and another, less pow- 
erful non-repetition FEC code (e.g., a convolutional 
code with rate 1/2 and memory 4) may be used for the 
Type-ll information. 

Other embodiments may use a hybrid ARQ feed- 
back channel. In these embodiments a FEC code may 
be used in an attempt to correct the Type-I information 
first before using the ARQ feedback channel to request 
re-transmission. 

Additional embodiments of the present invention 
may also use the above unequal error protection 
schemes to separately protect the Type-I A and Type-IB 
information. 

Still further embodiments of the present invention 
incorporate novel antenna diversity techniques from a 
Weerackody patent and other Weerackody patent ap- 
plications for transmitting JPEG images over slow fad- 
ing wireless channels. 

Other illustrative embodiments of the present inven- 
tion are presented at the end of this application for a 
storage system for JPEG images. 



For clarity of explanation, the illustrative embodi- 
ments of the present invention set forth below are pre- 
sented as functional blocks. The functions these blocks 
represent may be implemented with shared or dedicat- 

s ed hardware, including, but not limited to, hardware ca- 
pable of executing software. Illustrative embodiments 
may comprise digital signal processor hardware, such 
as the AT&T DSP16 or DSP32C, and software perform- 
ing the operations discussed below. Very large scale in- 

10 tegration (VLSI) hardware embodiments of the present 
invention, as well as hybrid DSP/VLSI embodiments, 
may also be provided. 

Illustrative Embodiments with ARQ Feedback 

is 

An illustrative embodiment of the present invention 
is shown in Figs. 5A and 5B. This embodiment of the 
present invention uses a Stop and Wait ARQ protocol 
for the Type-I information and no error protection for the 
20 Type-ll information. It will be readily apparent to one of 
ordinary skill in the art that other embodiments may use 
other ARQ protocols (such as Selective-Repeat ARQ 
and Go-back-N ARQ) for the Type-I information and a 
less powerful FEC or ARQ protocol for the Type-ll infor- 
ms rnation. 

Fig. 5A shows a transmitter 55 and Fig. 5B shows 
a receiver 56 according to the present invention. The 
transmitter in Fig. 5A comprises a separator 61 , an error 
detection encoder 62, modulators 63 and 80, a multi- 

30 plexer 64, and a repeat controller 92. For wireless ap- 
plications, the transmitter may also include one or more 
antennas and associated transmission circuits. 

The receiver 56 in Fig. 5B comprises a demultiplex- 
er 66, demodulators 67 and 81 , a decoder 68, a com- 

35 biner 69, and a repeat generator 90. 

In general, the transmitter in Fig. 5A receives a 
JPEG image from data source 60, such as, for example, 
a JPEG encoder and transmits the JPEG image over 
the forward channel 65 to the receiver 56 in Fig. 5B. The 

40 forward channel 65 can be a wire or wireless communi- 
cation medium. The transmitter sends the JPEG image 
over the forward channel 65 in packets as illustrated in 
Figs. 6A and 6B. 

At the receiver, the JPEG image information pack- 

45 ets are processed and, if no errors are detected, they 
are transferred to the data sink 70, which may be, for 
example a JPEG decoder. If an error is detected in any 
of the data packets a request for retransmission is sent 
by repeat generator 90 to transmitter 55 over the feed- 

50 back channel 91 shown in Fig. 5B. Like the forward 
channel, the feedback channel may be a wire or wireless 
communication medium. 

In more detail, a separator 62 according to the 
present invention separates the most sensitive Type-I 

55 JPEG information from the less sensitive Type-ll infor- 
mation, as discussed above. The separator 62 may be, 
for example, a digital signal processor (DSP) with suit- 
able software for separating the JPEG image into Type- 



EP 0 735 774 A2 



10 



I and Type-ll information, or further into Type-I A, Type- 
IB, and Type-ll information. 

The following is one example of how a DSP may be 
programmed to separate the Type-I information from the 
Type-ll information for a single frame, single scan JPEG 
image. Other methods not discussed below will be read- 
ily apparent to those of ordinary skill in the art for JPEG 
images having one or more frames 20 and one or more 
scans 23. 

The DSP in this example examines the incoming 
bytes of the JPEG image for the hexadecimal byte ff, 
which denotes a marker. If an ff byte is detected, the 
DSP examines the next byte in the data stream, namely 
the marker code which describes the function of the 
marker. The purpose here is to determine whether the 
marker also includes a segment of parameters which 
will follow the marker in the data stream. 

For example, if the next byte is hexadecimal d8 : the 
DSP knows that the marker is a start of image marker 
which has no parameters, as shown in the table in Fig. 
3. In this case, the DSP separates the entire two-byte 
marker (ffd8) from the JPEG stream. 

If, however, the next byte is hexadecimal db, the 
DSP knows that the marker is a define quantization table 
marker (ffdb) which has a variable length sequence of 
parameters following it in the data stream. As discussed 
above, markers with parameters following them are usu- 
ally called marker segments. 

In the case of a marker segment, the DSP examines 
the next two bytes in the data stream after the two-byte 
marker to determine the number of parameter bytes fol- 
lowing the marker. The DSP then separates the two- 
byte marker and its parameter bytes from the JPEG data 
stream. 

If a byte is not determined to be a marker or marker 
segment it is considered Type-ll entropy coded informa- 
tion and sorted as such from the JPEG data stream. 

In addition to separating the Type-I information from 
the Type-ll information, the DSP also appends certain 
position information to the Type-I information so that the 
JPEG image structure can be re-created at the receiver. 
Various ways of doing this for one or more image frames 
20, and one or more scans 23, will be readily apparent 
to those of ordinary skill in the art. 

For example, as shown in Fig. 1 , in a typical single 
frame, single scan JPEG image, all of the Type-I mark- 
ers and marker segments occur before the Type-ll en- 
tropy coded segments, with the exception of the Type-I 
restart markers and the end of image marker. Therefore, 
in a typical single frame, single scan JPEG image, only 
the positions of the end of image marker and restart 
markers need to be forwarded to the receiver. 

One way the DSP can code the positions of the end 
of image marker and the restart markers is to keep a 
running count of the number of bytes in the JPEG data 
stream and use the byte number of the first restart mark- 
er (ffdO) as the starting position for the modulo 8 se- 
quence of restart markers For example, if the first re- 



start marker (ffdO) is the 300th byte in the data stream, 
then its byte number is 300. 

Once the byte number of the first restart marker is 
determined, the DSP can identify the relative byte posi- 
s tions of the remaining restart markers in the modulo 8 
sequence (ffd1-ffd7). Specifically, the DSP may assign 
a byte number to each subsequent restart marker which 
corresponds to the number of entropy coded bytes be- 
tween it and the previous restart marker. 
10 With respect to the end of image marker, the DSP 
may identify its position by its byte number in the data 
stream. If there are 400 bytes in the JPEG image, then 
the position of the end of image marker will be 400. 
In an alternative embodiment, the positions of the 
is Type-IB restart markers are transmitted to the receiver 
without the restart markers themselves. This is because 
the restart markers occur in a known predetermined pat- 
tern (modulo 8 sequence: OxffdO, Oxffdl , 0xffd2, 0xffd3, 
0xffd4, OxffdS, 0xffd6, and 0xffd7) which can be gener- 
20 ated at the receiver. 

Continuing with the detailed explanation of the 
transmitter 55 in Fig. 5A, once separated from the Type- 
ll information, the Type-I information is encoded by an 
error detection encoder 62. The encoder forms Type-I 
25 information packets using error detection coding tech- 
niques known to those of ordinary skill in the art. A suit- 
able error detection encoder for wire or wireless appli- 
cations is a CRC-16 encoder which appends a 16-bit 
error detection code to the Type-I information packets 
30 The encoded Type-I information packets are then 
modulated by the modulator 63 for transmission over 
forward channel 65. Any suitable modulator may be 
used, such as, for example, a 4-DPSK modulator. 

The Type-ll information packets are not coded in 
35 this illustrative embodiment. The Type-ll information 
packets are passed along a separate transmitter chan- 
nel to a second modulator 80 where they are modulated 
for transmission over forward channel 65. As will be ex- 
plained in more detail below, the Type-ll information 
40 packets may be coded using a less powerful FEC coding 
technique, if desired or needed for a particular applica- 
tion. 

The modulated Type-I and Type-ll information 
packets may also be multiplexed over the forward chan- 

45 nel by multiplexer 64. The purpose behind multiplexing 
the Type-I and Type-ll information is to take advantage 
of the time slots (t, in Fig. 6A) left idle after each Type- 
I packet transmission, during which the transmitter waits 
for a positive or negative acknowledgement from the re- 

so ceiver. 

Fig. 6A shows one example of a flow of multiplexed 
Type-I and Type-ll information packets over a commu- 
nication medium. In Fig. 6A, the multiplexer multiplexes 
L Type-ll information packets in between Type-I infor- 
55 matbn packets. L can be fixed or variable. In addition, 
more than one Type-I packet can be transmitted after 
each group of L Type-ll packets, as shown in Fig. 6C. 
It will be readily apparent to those of ordinary skill 
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in the art that a single encoding channel may be used 
for transmitter 55. It will also be readily apparent to those 
of ordinary skill in the art that the placement of the mul- 
tiplexer 64 in transmitter 55 is only illustrative. For ex- 
ample, the multiplexer 64 may be placed in advance of 
the modulation so that a single modulator may be used 
for both the Type-I and Type-ll information as shown in 
Fig. 7G. 

Continuing with the packet flow, the multiplexed 
Type-I and Type-ll information packets travel over the 
forward channel 65 to a complementary receiver 56 in 
Fig. 5B for processing. The de-multiplexer 66 in Fig. 5B 
serves to direct the multiplexed Type-I and Type-ll infor- 
mation packets along separate channels in the receiver 
56 for processing by circuitry associated with the type 
of error protection each type of information is afforded. 

The Type-I information packets are then demodu- 
lated by demodulator 67. Any suitable demodulator may 
be used, such as : for example, a4-DPSK demodulator 
A suitable error detection decoder is a CRC-1 6 decoder. 

Once demodulated, the Type-I information packets 
are decoded by error detection decoder 68. Among oth- 
er things, decoder 68 functions to re-calculate the error 
detection code for each information packet and com- 
pare it to the error detection code transmitted with the 
Type-I information packet. If the two codes match, pre- 
sumably there is no error in the transmitted packet. If 
the two codes do not match, there is at least one error 
in the transmitted packet. 

If an error is found, the packet is normally discarded, 
and a request to re-send the packet is sent over the 
feedback channel 91 by the repeat generator 90 in the 
form of a negative acknowledgement (NAK). The repeat 
controller 92 shown in Fig. 5A responds to this request 
by re-sending the same packet. Each packet may be 
stored before transmission in a buffer or other suitable 
memory device. For purposes of illustration, the packet 
stream in Fig. 6B shows the same Type-I information 
packet (packet 1) being re-sent 

If no error is found, the Type-I information packet is 
forwarded to combiner 69, and this time a positive ac- 
knowledgement (ACK) is sent by the repeat generator 
90 over the feedback channel to the transmitter 55. In 
response to the positive acknowledgement, the repeat 
controller 92 sends the next data packet, as illustrated 
in Fig. 6A. 

Turning to the Type-ll information packets, they are 
also demodulated, but by de-modulator 81 . Because the 
Type-ll information packets in this example of the 
present invention have not been encoded with any error 
detection or correction code, they are sent directly to the 
combiner 69 after being demodulated. 

The combiner 69 combines the Type-I and Type-ll 
information packets into a structure suitable for the data 
sink 70, which normally will be the JPEG structure 
shown in Fig. 1 . The combiner 69 may be a digital signal 
processor (DSP) which is programmed to combine the 
Type-I and Type-ll information. 



For example, the DSP may be programmed to place 
the first restart marker and the end of image marker at 
their respective byte number positions in the data 
stream. Each of the other restart markers is placed at a 

s byte position relative to the preceding restart marker. As 
discussed above, the relative position of each restart 
marker was coded by separator 62 as the number of 
Type-ll information bytes after the preceding restart 
marker. Finally, if only the positions of the restart mark- 

10 ers are sent, the DSP may also be further programmed 
to generate the modulo 8 sequence of restart markers 
at the coded relative byte positions. 

In another illustrative embodiment of the present in- 
vention the transmitter 55 and receiver 56 in Figs. 5A 

is and 5B, respectively, are modified to include an error 
correction encoder-decoder pair 78, 83 for encoding the 
Type-ll information with a suitable, less powerful FEC 
code, such as, for example, a rate 1/2, memory 4 con- 
volutional FEC code. In addition, a block interleaver- 

20 deinterleaver pair 79, 82 is also included. This embodi- 
ment is shown in Figs. 5C and 5D. 

A transmitter 55A is shown in Fig. 5C. As discussed 
above, the transmitter 55A is basically the same as the 
transmitter 55 in the Fig. 5A embodiment, with the ex- 

25 ception of error correction encoder 78 and block inter- 
leaver 79, which have been added to the Type-ll chan- 
nel. 

The error correction encoder 78 (otherwise known 
to those of skill in the art as a channel encoder or chan- 
30 nel coder) encodes the Type-ll information with a rate 
1/2, memory 4 convolutional code to improve the signal 
transmission performance of the Type-ll information 
packets. 

The block interleaver 79 writes the bits of each en- 

35 coded Type-I packet into an m x n memory matrix in a 
column-wise fashion and reads the bits out row-wise. 
Therefore, if a burst error of length n were to occur, the 
interleaver would function to effectively convert the burst 
error into single bit errors, which are much easier to cor- 

40 rect. In sum, the interleaver serves to randomize the 
burst errors, which is especially helpful on slow fading 
wireless channels. 

A receiver 56A is shown in Fig. 5D. As discussed 
above, the receiver 56A is the same as the receiver 56 

45 shown in Fig. 5B, with the exceptbn of de-interleaver 
82 and error correction decoder 83. The de-interleaver 
82 performs the inverse operation of the interleaver 79. 
The bits from the incoming Type-ll information packets 
are stored row-wise in an m x n memory matrix and read 

so out column-wise. 

The error correction decoder 83 in this embodiment 
will normally use the Viterbi algorithm with soft decisions 
to decode the received Type-ll information, but other al- 
gorithms known to those of ordinary skill in the art may 

55 also be used. 

In still another alternative embodiment of the 
present invention using ARQ feedback, the Type-I infor- 
mation is separated into Type-I A and Type-IB informa- 
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tion and the Type-IA information is provided with more 
powerful error protection than the Type-IB information. 
An example of such an embodiment is shown in Figs. 
5E and 5F. 

In this embodiment, the separator functions to sep- 
arate the JPEG image into Type-IA, Type-IB, and Type- 
II information, and the combiner functions to combine 
all three types of information into a JPEG structure suit- 
able for the data sink 70. 

In this embodiment the separator DSP may be pro- 
grammed to further separate the Type-I information into 
Type- 1 A and Type-IB information. For example, the DSP 
may separate or sort the restart markers from the other 
Type-I markers using the second byte of each marker 
which identifies its function. As shown in the table in Fig. 
2, if the byte after the ff byte is d0-d7, the marker is a 
restart marker and the DSP will separate it from JPEG 
data stream as Type-IB information. Position informa- 
tion may be coded by the separator as already de- 
scribed. 

The combiner DSP, in turn, may combine all three 
types of information in the manner described above. 

As shown in Fig. 5E, the transmitter 55A of Fig. 5C, 
(now transmitter 55B) has been modified to include an 
additional encoding channel for processing the Type-IB 
information. The Type-IA information is still processed 
along the same ARQ-based channel as the Type-I in- 
formation in Figs. 5A and 5C. The Type-IB channel of 
transmitter 55B includes an error correction encoder 
78A, a block interleaver 79A, and a modulator 80A, cor- 
responding to the encoder 78, block interleaver 79, and 
modulator 80 described in Fig. 5C for the Type-I I infor- 
mation. Moreover, by way of example only, error correc- 
tion encoder 78A uses the same less powerful, convo- 
lutional code as used by encoder 78 for the Type-ll in- 
formation, namely a rate 1/2, memory 4 convolutional 
code. 

As shown in Fig. 5F, the receiver 56A of Fig. 5D, 
(now receiver 56B) has been modified to include a sep- 
arate decoding channel for the Type- IB information, with 
the Type-IA information still being decoded on the same 
Type-I channel shown in Figs. 5B and 5D. Specifically, 
the Type-IB channel includes a demodulator 81 A, a 
block interleaver 82A, and an error correction decoder 
83A. The decoding process for the Type-IB information 
is the same as the decoding process used for the Type- 
1 1 information because the same convolutional code was 
used for both the Type-IB and Type-ll information in this 
illustrative embodiment. As mentioned above, the de- 
coding process normally uses the Vrterbi algorithm. 

Illustrative FEC Embodiments Without ARQ Feedback 

Figs. 7A and 7B show one illustrative embodiment 
of the present invention which does not use an ARQ pro- 
tocol for the Type-I information packets. This illustrative 
embodiment uses a simple repetition -type FEC protocol 
instead. There is no feedback channel in this embodi- 



ment for re-transmitting an erroneous Type-I information 
packet. Moreover, this embodiment of the present in- 
vention is adapted for use in a wireless environment, but 
it will be understood by those of ordinary skill in the art 

5 that this embodiment can be readily adapted for use in 
a wire environment. 

Fig. 7A shows a transmitter 95 suitable for use with 
this embodiment and Fig. 7B shows a receiver 96 suit- 
able for receiving and processing JPEG information 

10 packets transmitted using a repetition protocol. 

The transmitter 95 in Fig. 7A includes, by way of 
example only, a separator 101, an error correction en- 
coder 102 s a 4-DPSK modulator 104, a 4-DPSK modu- 
lator 122, a multiplexer 105, transmission circuitry 106A 

is (comprising conventional carrier, pulse-shaping, and 
power amplification circuitry), and an antenna 106B. 

The receiver 96 shown in Fig. 7B includes, by way 
of example, an antenna 106C, conventional front-end 
receiver circuits 106D (comprising, for example, low 

20 noise amplifiers, RF/IF band-pass filters, and a match 
filter), demultiplexer 107, and 4-DPSK demodulator 
108. 

In this embodiment, each Type-I packet is sent K 
times, giving rise to a 1/K repetition type code, where K 
2S is a predetermined number The Type-ll information 
packets, on the other hand, are only transmitted once, 
giving rise to unequal error protection for the Type-I and 
Type-ll information packets, with more powerful error 
protection being provided for the Type-I information 
30 packets than the Type-ll information packets. 

A JPEG image is input from the data source 100 to 
the separator module 101 which separates the JPEG 
information into Type-I and Type-ll information. A pre- 
determined number of copies (K copies) of each Type- 
35 | information packet are formed by the error correction 
encoder 102. The encoded Type-I information packets 
are modulated by the 4-DPSK modulator 104 for trans- 
mission over a wireless communication medium by way 
of transmission circuits 106A and antenna 106B. 
40 As mentioned above, the Type-ll information pack- 
ets are not protected against errors. Rather, the Type II 
information packets are modulated as is by the second 
4-DPSK modulator 122 and multiplexed with the modu- 
lated Type-I information packets by multiplexer 105. 
45 The multiplexed Type-I and Type-ll information 
packets are then transmitted across the wireless medi- 
um to receiver 96 via transmission circuit 1 06A and an- 
tenna 106B. Fig. 6B shows the multiplexed Type-I and 
Type-ll information packets associated with a repetition 
so code calling for two copies of each Type-I information 
packet. In this embodiment, L (fixed or variable) Type-ll 
information packets are transmitted between one or 
more Type-I information packets, providing some limited 
time diversity. 

55 Antenna 106C and receiver circuits 106D in receiv- 
er 96 capture the multiplexed Type-I and Type-ll infor- 
mation packets. Once received, the Type-I and Type-ll 
information packets are de-multiplexed for processing 



8 



15 



EP 0 735 774 A2 



16 



along separate channels, although one of ordinary skill 
in the art will understand that other embodiments may 
use only a single decoding channel. 

The Type-I information packets are de-modulated 
by the first de-modulator 108 and stored in a buffer or 
other suitable memory device for combining by the cor- 
rection decoder 110. Any suitable algorithm for combin- 
ing the K copies of each Type-I information packet may 
be used. 

As for the Type-I I information packets in this em- 
bodiment, they are also de-modulated, but by a second 
4-DPSK de-modulator 123, after which, they are trans- 
mitted directly to combiner 111 to be combined with the 
Type-I information packets for the purpose of formatting 
the Type-I and Type-ll information packets with a JPEG 
structure suitable for data sink 112. 

An alternative embodiment may include, for exam- 
ple, the error correction encoder-decoder pair 78, 83 
shown in Figs. 5C and 5D to encode the Type-ll infor- 
mation with a less powerful non-repetition FEC code, 
such as the rate 1/2, memory 4 convolutional code men- 
tioned above. In this embodiment, the Type-I informa- 
tion may be coded, for example, with a more powerful 
non -repetition FEC code, such as a rate 1/3, memory 4 
convolutional code. The inter leave r-deinterleaver pair 
7g, 82 shown for the Type-ll information in Figs. 5C and 
5D may also be used for the Type-I information channel 
in the transmitter and receiver, respectively. 

This alternative embodiment is shown in Figs. 7C 
and 7D. Fig. 7C shows a transmitter 95A and Fig. 7D 
sfiows a receiver 96A according to the present inven- 
tion. The transmitter 95A in this illustrative embodiment 
includes an error correction encoder 120 for encoding 
the Type-ll information packets with one convolutional 
code and an error correction encoder 102 for encoding 
the Type-I information packets with another, more pow- 
erful convolutional code or other error correction code. 
In addition, the transmitter 95A also includes block in- 
terleaves 103 and 121 for interleaving the encoded 
Type-I and Type-ll information packets, respectively. 

The components in receiver 96A of Fig. 7D for re- 
versing the encoding and interleaving of the Type-I and 
Type-ll packets are the error correction decoders 110 
and 1 25 and the block deinterleavers 109 and 124. 

A still further embodiment of the present invention 
without an ARQ feedback channel is shown in Figs. 7E 
and 7F. A transmitter 95B is shown in Fig. 7E and a re- 
ceiver 96B is shown in Fig. 7F. This embodiment is a 
modification of the receiver and transmitter shown in 
Figs. 7C and 7D, respectively. 

As shown in Figs. 7E and 7F, this embodiment fur- 
ther separates the Type-I information into Type-I A and 
Type-IB information and includes an additional encod- 
ing channel and decoding channel for the Type-IB infor- 
mation. Specifically, transmitter 95B in Fig. 7E includes 
an additional error correction encoder 120 A, block inter- 
leaver 121 A, and 4-DPSK modulator 122 A for the Type- 
IB information. The receiver 96B, in turn, includes an 



additional error correction decoder 1 25A, block deinter- 
leaver 124A, and 4-DPSK demodulator 123A. 

By way of example only, the Type-IB information is 
encoded with the same code as the Type-ll information, 

5 namely a rate 1/2. memory 4 convolutional code, and 
the Type-IA information is still encoded with the more 
powerful rate 1/3, memory 5 convolutional code. Alter- 
natively, the Type-IB and Type-ll information may also 
be encoded with unequal error protection, with the Type- 

io IB information encoded with more powerful error protec- 
tion than the Type-ll information. 

For purposes of illustration, in another embodiment, 
the present invention multiplexes the Type-I and Type- 
ll information packets in advance of modulation. And on 

is the receiving end, the Type-I and Type-ll information 
packets are demodulated before being demultiplexed. 

This embodiment is shown in Figs. 7G and 7H. A 
transmitter 95C is shown in Fig. 7G and a receiver 96C 
is shown in Fig. 7H. The transmitter 95C is a modifica- 

20 tion of the transmitter 95A shown in Fig. 7C. As shown 
in Fig. 7G, the multiplexer 105 of Fig. 7C has been 
placed in advance of any modulation, and only modula- 
tor 104 is used to modulate the multiplexed Type-I and 
Type-ll information packets. 

25 a complementary receiver 96C is shown in Fig. 7H. 
Receiver 96C is a modification of the receiver 96A in 
Fig. 7D. As shown in Fig. 7H, the receiver 96 A of Fig. 
7D has been modified to place the demultiplexer 107 
after the demodulation of the Type-I and Type-ll infor- 

30 mation packets. Moreover, only demodulator 108 re- 
mains for demodulating the interleaved Type-I and 
Type-ll information packets. 

Illustrative Marker Detection Embodiment 

35 

Although not mentioned above, transmission errors 
may convert Type-ll information into markers, which 
may result in loss of the entire image, such as in situa- 
tions where Type-ll information is converted to a start of 

40 image marker (0xffd8) or end of image marker (0xffd9). 
To solve this problem, a further embodiment of the 
present invention includes a marker detector for detect- 
ing the presence of markers in the Type-ll information. 
This illustrative embodiment of the present inven- 

45 tion is shown in Fig. 71. The receiver 96D shown in Fig. 
71 is a further modification of the receiver 96A shown in 
Fig. 7D. The receiver 96A in Fig. 7D has been modified 
in this embodiment to include a marker detector 1 26 in 
the Type-ll decoding channel. The marker detector 126 

50 examines the Type-ll information packets for Type-I 
markers or marker segments. If a marker is found, at 
least one f in the marker may be replaced by a random 
bit pattern so that the JPEG decoder (data sink 112) 
does not detect an erroneous marker in the Type-ll in- 

55 formation. 
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Illustrative Embodiments with Hybrid ARQ F eedback 

An illustrative embodiment of the present invention 
using a Hybrid ARQ protocol is shown in Figs. 8A and 
8B. Fig. 8A shows a transmitter 55B and Fig. 8B shows 
a receiver 56B. This embodiment is a modification of the 
ARQ embodiment shown in Figs. 5C and 5D. In this em- 
bodiment, an error correction encoder 78A and a block 
interleaver 79A are added to the Type-I encoding chan- 
nel of transmitter 55A. In addition, a corresponding error 
correction decoder 83A and a block deinterleaver 82A 
are added to the Type-I decoding channel of receiver 
56A. 

The error correction encoder 78A in transmitter 55B 
of Fig. 8A further encodes the Type-I information pack- 
ets with an error correction code in addition to an error 
detection code. The error correction decoder 83A in re- 
ceiver 56B of Fig. 8B decodes the error correction code 
first before the error detection code is used. This way, 
only in situations where there are errors in the Type-I 
information packets which the error correction decoder 
cannot correct, will a request for retransmission be sent 
by the repeat generator 90 to transmitter 55B. 

In this embodiment, the error correction code pro- 
vided by encoder 83A for the Type-I information need 
not be more powerful than the error correction code pro- 
vided by encoder 83 for the Type-ll information. The 
Type-I information is provided with more powerful error 
protection as a result of the ARQ feedback channel an- 
yway. For example, both the Type-I and Type-ll informa- 
tion may be provided with the same rate 1/2. memory 4 
convolutional code. 

Fig. 8C shows another illustrative embodiment of 
the present invention, namely a transmitter 55C with 
multiplexer 64 placed in advance of the encoding proc- 
ess rather than after the encoding process. As men- 
tioned above, multiplexer 64 serves to multiplex the 
Type-I and Type-H information packets to take advan- 
tage of the time slots between transmissions of Type-I 
packets. 

After being multiplexed, the error detection encoder 
62 appends an error detection code to each packet for 
use with the ARQ retransmission protocol described 
above and the error correction encoder 78A further en- 
codes each Type-I packet, by way of example, with a 
1/2 repetition code, which means that each Type-I pack- 
et is transmitted twice whereas each Type-ll packet is 
only transmitted once. The packet stream for this em- 
bodiment is shown in Fig. 6B. 

A complementary receiver 56C (not shown) is pro- 
vided with this embodiment. 

Illustrative Embodiments for Slow Fading Channels 

Techniques which can be used with the present in- 
vention are set forth in three co-pending patent applica- 
tions which use novel antenna diversity schemes to re- 
duce the effects of multipath fading on slow fading wire- 
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less channels. The antenna diversity techniques serve 
to increase the correcting power, and thus the error pro- 
tection power, of an FEC code. 

The first such application is entitled "SWITCHED 

5 ANTENNA DIVERSITY TRANSMISSION METHOD 
AND SYSTEM," US Application Serial No. 08/414987. 

The second is entitled "FAST FADING PACKET DI- 
VERSITY TRANSMISSION METHOD AND SYSTEM," 
US Application Serial No. 08/415893. 

10 The third is entitled "ORTHOGONAL POLARIZA- 
TION AND TIME VARYING PHASE OFFSETTING OF 
SIGNALS FOR DIGITAL DATA TRANSMISSION OR 
RECEPTION" EP-A-O 656 697. 

In addition, the antenna diversity techniques in U. 

is s. Patent No. 5 : 305,353 to Weerackody may also be 
used to reduce the effects of multipath fading on slow 
fading channels. 

Illustrative Storage Embodiments 

20 

The present invention may also be used to reduce 
the storage requirements for a JPEG image and thus 
the costs associated with storing a JPEG image. In this 
regard, the present invention is applicable to any type 
25 of storage device known to those of ordinary skill in the 
art, including, for example, electronic storage devices, 
magnetic storage devices, optical storage devices, elec- 
tro-optical storage devices, and magneto-optical stor- 
age devices. 

30 An illustrative storage system of the present inven- 
tion is shown in Figs. 9A and 9B. Fig. 9A shows a re- 
corder 1 25 according to the present invention, and Fig. 
9B shows a reader 1 26 according to the present inven- 
tion. 

35 The illustrative recorder 125 in Fig. 9A includes a 
separator 132, error correction encoders 134 and 136, 
a multiplexer 138, and a storage recorder (or writing) 
device 1 34. 

The illustrative reader 1 26 includes a storage read- 
40 ing (or playing) device, a demultiplexer 146, error cor- 
rection decoders 148 and 150, and a combiner 152. 

In operation, the JPEG image is input from an input 
device 130, which may be a standard JPEG encoder. 
The separator 132 in the recorder 125 separates the 
45 JPEG image into Type-I and Type-ll information as de- 
scribed above for the other embodiments of the present 
invention. 

The error correction encoders 134 and 136 encode 
the Type-I and Type-ll information with unequal error 

50 correction, wherein the Type-I information is encoded 
with more powerful error protection than the Type-ll in- 
formation. For example, in the case of an optical storage 
disc, the Type-I information may be encoded with a more 
powerful Reed-Solomon code than the Type-ll informa- 

55 tion. The multiplexer multiplexes the encoded Type-I 
and Type-ll information, as required for a particular ap- 
plication, for storage. by the storage recorder 140 in or 
on the storage medium 142. 
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The storage reader 144, in turn, is used to retrieve 
or read the JPEG information from the storage medium 
142. As the Type-l and Type-ll information is read from 
the storage device it is demultiplexed for decoding on 
separate channels by the error correction decoders 1 48 
and 150. The decoded Type-l and Type-ll information is 
then combined by the combiner 152 for use by output 
device 154. For example, the output device 1 54 may be 
a suitable display device or standard JPEG decoder 

In another illustrative storage embodiment, the sep- 
arator 132 may further separate the JPEG image into 
Type-l A : Type-IB, and Type-ll information and the com- 
biner 1 52 may re-create the JPEG image from the Type- 
IA, Type-IB, and Type-ll information. 

This embodiment is shown in Figs. 9C and 9D. Spe- 
cifically, a recorder 1 25 A is shown in Fig. 9C, and a read- 
er (or player) 126A is shown in Fig. 9D. This embodi- 
ment is a modification of the embodiment shown in Figs. 
9A and 9B. In this embodiment, an additional encoding 
channel has been added to the recorder 1 25, and an 
additional decoding channel has been added to the 
reader 126, for the Type-IB information. 

As shown in Fig. 9C, the additional encoding chan- 
nel includes encoder 136A. As shown in Fig. 9D, the 
additional decoding channel includes decoder 150A. 
The Type- IB information may be encoded with a Reed- 
Solomon code or other error correction code which is 
less powerful than the error correction code being used 
for the Type-l information. 
€ 

Claims 

1. An apparatus for transmitting a JPEG image over a 
communication medium to a receiver, comprising: 

a separator for separating the JPEG image into 
Type-l and Type-ll information; and 
a transmitter for transmitting the Type-l infor- 
mation over the communication medium with 
more powerful error protection than the Type-ll 
information. 

2. An apparatus for receiving Type-l and Type-ll infor- 
mation of a JPEG image transmitted over a com- 
munication medium with unequal error protection, 
comprising: 

a receiver adapted for processing the Type-l 
and Type-ll information; and 
a combiner for combining the processed Type- 
I and Type-ll information. 

3. An apparatus for transmitting a JPEG image over a 
communication medium to a receiver, comprising: 

a separator for separating the JPEG image into 
Type-l A and Type-IB information; and 



a transmitter for transmitting the Type-IA infor- 
mation over the communication medium with 
more powerful error protection than the Type- 
IB information. 

5 

4. An apparatus for receiving Type-IA and Type-IB in- 
formation of a JPEG image transmitted over a com- 
munication medium with unequal error protection, 
comprising: 

10 

a receiver adapted for processing the Type-la 
and Type-IB information; and 
a combiner for combining the processed Type- 
IA and Type-IB information. 

15 

5. A transmitter for transmitting a JPEG image over a 
communication medium to a receiver with unequal 
error protection, comprising: 

20 an error detection encoder for encoding Type- 

I information of the JPEG image with an error 
detection code; 

a modulator for modulating the error detection 
encoded Type-l information and for modulating 

25 Type-ll information of the JPEG image for 

transmission over a forward channel of the 
communication medium to the receiver; and 
a repeat controller for re-transmitting the error 
detection encoded Type-l information in re- 

30 sponse to a retransmission request from the re- 

ceiver transmitted over a feedback channel of 
the communication medium. 

6. The transmitter of claim 5, further comprising a sep- 
35 arator for separating the JPEG image into Type-l 

and Type-ll information. 

7. The transmitter of claim 5, further comprising an er- 
ror correction encoder for encoding the Type-ll in- 

40 formation with an error correction code. 

8. The transmitter of claim 5, further comprising an er- 
ror correction encoder for encoding the Type-l in- 
formation with an error correction code. 

45 

9. A transmitter for transmitting a JPEG image over a 
communication medium to a receiver with unequal 
error protection, comprising: 

so an error correction encoder for encoding the 

Type-l information with an error correction 
code; and 

a modulator for modulating the error correction 
encoded Type-l information and for modulating 
ss Type-ll information of the JPEG image for 

transmission over the communication medium 
to the receiver. 
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10. The transmitter of claim 9 : further comprising a sep- 
arator for separating the JPEG image into Type-I 
and Type-I I information. 

11. The transmitter of claim 9, further comprising an er- 
ror correction encoder for encoding the Type-ll in- 
formation with a less powerful error correction code. 

1 2. A receiver adapted for processing modulated, error 
detection encoded Type-I information and modulat- 
ed Type-ll information of a JPEG image transmitted 
over a forward channel of a communication medium 
with unequal error protection, comprising: 

a demodulator for demodulating the Type-I and 
Type-ll information; 

an error detection decoder for decoding the de- 
modulated Type-I information to determine if 
there are any errors in the Type-I information; 
and 

a repeat generator for sending a retransmission 
request to the transmitter over a feedback 
channel of the communication medium if errors 
are detected in the Type-I information. 

1 3. The receiver of claim 12, further comprising a com- 
biner for combining the Type-I and Type-ll informa- 
tion. 

14. The receiver of claim 12, wherein the modulated 
Type-ll information is encoded with an error correc- 
tion code, further comprising an error correction de- 
coder for decoding the Type-ll information. 

15. The receiver of claim 12, wherein the Type-I infor- 
mation is further encoded with an error correction 
code, further comprising an error correction decod- 
er for decoding the encoded Type-I information. 

16. The receiver of claim 12, further comprising a proc- 
essor for detecting hexadecimal ff bytes in the de- 
modulated Type-ll information and for replacing at 
least one f of each detected ff byte with a random 
bit pattern. 

17. A receiver adapted for processing modulated, error 
correction encoded Type-I information and modu- 
lated Type-ll information of a JPEG image transmit- 
ted over a communication medium with unequal er- 
ror protection, comprising: 

a demodulator for demodulating the Type-I and 
Type-ll information; and 
an error correction decoder for decoding the 
demodulated Type-I information. 

18. The receiver of claim 17, further comprising a com- 
biner for combining the decoded Type-I and Type- 



ll information. 

19. The receiver of claim 17, wherein the modulated 
Type-ll information is encoded with an error correc- 

5 tion code, further comprising an error correction de- 
coder for decoding the Type-ll information. 

20. The receiver of claim 17, further comprising a proc- 
essor for detecting hexadecimal ff bytes in the de- 

10 coded Type-ll information and for replacing at least 
one f of each detected ff byte with a random bit pat- 
tern. 

21 . A method of transmitting a JPEG image over a com- 
is munication medium to a receiver with unequal error 

protection, comprising: 

separating the JPEG image into Type-I and 
Type-ll information; and 
20 transmitting the Type-I information over the 

communication medium to the receiver with 
more powerful error protection than the Type-ll 
information. 

25 22. A method of receiving Type-I and Type-ll informa- 
tion of a JPEG image transmitted over a communi- 
cation medium with unequal error protection, com- 
prising: 

30 receiving the Type-I and Type-ll information 

from the communication medium; 
processing the Type-I and Type-ll information; 
and combining the processed Type-I and Type- 
ll information. 

35 

23. A method of transmitting a JPEG image over a com- 
munication medium to a receiver, comprising: 

separating the JPEG image into Type-IA and 
40 Type-IB information; and 

transmitting the Type-IA information over the 
communication medium to the receiver with 
more powerful error protection than the Type- 
IB information. 

45 

24. A method of receiving Type-IA and Type-IB infor- 
mation of a JPEG image transmitted over a com- 
munication medium with unequal error protection, 
comprising: 

so 

receiving the Type-IA and Type-IB information 
from the communication medium; 
processing the Type-IA and Type-IB informa- 
tion; and 

55 combining the processed Type-IA and Type-IB 

information. 

25. A method of transmitting a JPEG image over a com- 
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rnunication medium to a receiver with unequal error 
protection, comprising: 

encoding Type-I information of the JPEG image 
with an error detection code; s 
modulating the error detection encoded Type-I 
information for transmission over a forward 
channel of the communication medium to the 
receiver; 

modulating Type-ll information of the JPEG im- 10 
age for transmission over the forward channel 
of the communication medium to the receiver; 
and 

re-transmitting the error detection encoded 
Type-I information in response to a retransmis- is 
sion request from the receiver transmitted over 
a feedback channel of the communication me- 
dium. 

26. The method of claim 25, further comprising the step 20 
of separating the JPEG image into Type-I and Type- 

II information. 

27. The method of claim 25, further comprising the step 

of encoding the Type-ll information with an error 2s 
correction code. 

28. The method of claim 25, further comprising the step 
of encoding the Type-I information with an error cor- 
rection code. 30 

29. A method of transmitting a JPEG image over a com- 
munication medium to a receiver with unequal error 
protection, comprising: 

3S 

encoding Type-I information of the JPEG image 
with an error correction code; 
modulating the error correction encoded Type- 
I information for transmission over the commu- 
nication medium to the receiver; and *o 
modulating Type-ll information of the JPEG im- 
age for transmission over the communication 
medium to the receiver. 

30. The method of claim 29, further comprising the step 
of separating the JPEG image into Type-I and Type- 
II information. 

31 . The method of claim 29, further comprising the step 

of encoding the Type-I I information with a less pow- so 
erf ul error correction code. 

32. A method of processing modulated, error detection 
encoded Type-I information and modulated Type-ll 
information of a JPEG image transmitted over a for- ss 
ward channel of a communication medium with Un- 
equal error protection, comprising: 



demodulating the Type-I and Type-ll informa- 
tion; 

decoding the error detection code of the de- 
modulated Type-I information to determine if 
there are any errors in the Type-I information; 
and 

sending a retransmission request to the trans- 
mitter over a feedback channel of the commu- 
nication medium if errors are detected in the 
Type-I information. 

33. The method of claim 32, further comprising the step 
of combining the Type-I and Type-ll information. 

34. The method of claim 32, wherein the modulated 
Type-ll information is encoded with an error correc- 
tion code, further comprising the step of decoding 
the encoded Type-ll information. 

35. The method of claim 32. wherein the Type-I infor- 
mation is encoded with an error correction code, fur- 
ther comprising the step of decoding the Type-I in- 
formation. 

36. The method of claim 32, further comprising the 
steps of detecting hexadecimal ft bytes in the de- 
modulated Type-ll information and replacing at 
least one f of each detected ff byte with a random 
bit pattern. 

37. A method of processing modulated, error correction 
encoded Type-I information and modulated Type-ll 
information transmitted over a communication me- 
dium with unequal error protection, comprising: 

demodulating the Type-I and Type-ll informa- 
tion; and 

decoding the demodulated Type-I information. 

38. The method of claim 37, further comprising the step 
of combining the Type-I and Type-ll information. 

39. The method of claim 37, wherein the Type-ll infor- 
mation is encoded with an error correction code, fur- 
ther comprising the step of decoding the Type-ll in- 
formation. 

40. The method of claim 37, further comprising the 
steps of detecting hexadecimal ff bytes in the Type- 
ll information and replacing at least one f of each 
detected ff byte with a random bit pattern. 

41. An apparatus for detecting the occurrence of Type- 
I information in Type-ll information of a JPEG im- 
age, comprising: 

a processor for detecting hexadecimal ff bytes 
in the Type-ll information and for replacing at least 
one f of each detected ff byte with a random bit pat- 



13 



25 



EP 0 735 774 A2 



26 



tern. 

42. A method of detecting the occurrence of Type-I in- 
formation in Type-H information of a JPEG image, 
comprising: 

detecting hexadecimal ff bytes in the Type-ll in- 
formation; and 

replacing at least one f of each detected ff byte 
with a random bit pattern. 

43. An apparatus for storing a JPEG image in or on a 
storage medium with unequal error protection, com- 
prising: 

a separator for separating the JPEG image into 

Type-I and Type-ll information; 

an error correction encoder for encoding the 

Type-I information with a more powerful error 

correction code than the Type-ll information; 

and 

a storage recorder for storing the encoded 
Type-I and Type-ll information in or on the stor- 
age medium. 

44. An apparatus for storing a JPEG image in or on a 
storage medium with unequal error protection, com- 
prising: 

a separator for separating the JPEG image into 

Type-I A and Type-IB information; 

an error correction encoder for encoding the 

Type-I A information with a more powerful error 

correction code than the Type-IB information; 

and 

a storage recorder for storing the encoded 
Type-IA and Type-IB information in or on the 
storage medium. 

45. An apparatus for reading encoded Type-I and Type- 
1 1 information of a JPEG image stored in or on a stor- 
age medium with unequal error protection, compris- 
ing: 

a storage reader for reading the encoded Type- 
I and Type-ll information stored in or on the 
storage medium; 

an error correction decoder for decoding the 
encoded Type-I and Type-ll information; and 
a combiner for combining the decoded Type-I 
and Type-ll information. 

46. An apparatus for reading encoded Type-IA and 
Type-IB information of a JPEG image stored in or 
on a storage medium with unequal error protection, 
comprising: 

a storage reader for reading the encoded Type- 



IA and Type-IB information stored in or on the 
storage medium; 

an error correction decoder for decoding the 
encoded Type-I A and Type-IB information; and 
5 a combiner for combining the decoded Type-IA 

and Type-IB information. 
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